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ABSTRACT 

This study delineates the structure of the 
educational journal literature, and its relationship to surrounding 
psychological journals. Citations amongst 140 heavily cited, widely 
circulating journals were used to define the interrelationships 
between the journals, and by inference between the research areas 
they represent. All education journals of wide circulation which 
contained 100 or more references per year were used in the study. All 
of the maps and measures emphasize the dominant influence psychology 
has as the primary source of knowledge for education research. 
Elementary education and guidance are in the mainstream of education 
literature while higher and general education *ire not. Science 
education and special education are compact, self contained subfields 
having few connections with other education literature. Two-step 
citation maps linked each journal with the two journals it cites most 
frequently. The citation chains formed subfields maps showing the 
interrelationships between different graphic clusters of journals. A 
cluster analysis, using all of the citations from each journal, 
confirmed the subfield clusters generated by the graphic methodology. 
Hierarchies were constructed illustrating dependency relationships 
between the individual journals and between clusters of journals. 
Procedures were developed which isolated general and subfield core 
journals, and journals peripheral to education. (Author) 




U • Df PAMTMCMT OF HEALTH. 
EDUCATION ft WELT ARE 



CO 



CATION POSITION OH WUCV 



FINAL REPORT 



Project No. l-E-164 
Contract No. OEC-5-72-0022 (509) 



ANALYSIS OF RESEARCH JOURNALS 
AND RELATED RESEARCH STRUCTURE, 
IN EDUCATION 



Paul Barron 
and 

Francis Narin 

Computer Horizons, inc. 
53 West Jackson Boulevard 
Chicago, Illinois 60604 



October 31, 1972 



The research reported herein was performed pursuant to a 
contract with tne Office of Education, U.S. Department of 
Healt':, Education, and Welfare. Contractors undertaking 
such projects under Government sponsorship are encouraaed 
to express freely their professional judgment in the con- 
duct of the project. Points of view or opinions stated do 
not, therefore, necessarily represent official Office of 
Education position or policy. 



U.S. DEPARTMENT OF 
HEALTH, EDUCATION, .kND WELFARE 



UJ 



Office of Education 
National Center for Educational Research and Development 



Special 
Education 



Science 

and 
Science 
Education 



Child 
Development 



I 
I 

I 
I 



Experimental 
Psychology 



Higher 

and 
General 
Education 



Elementary 
Education 
and 
Research 



m L 




Educational 
Psychology 
and 
Research 




Clinical 
Psychology 



FRONTISPIECE - CITING BETWEEN SUBFIELDS OF EDUCATION 



ABSTRACT 



This study delineates the structure of the educational 
journal literature, and its relationship to surrounding psy- 
chological journals. Citations amongst 140 heavily cited, 
widely circulating journals were used to define the interre- 
lationships between the journals, and by inference between the 
research areas they represent. All education journals of wide 
circulation which contained 100 or more references per year 
were used in the study. 

All of the maps and measures emphasize the dominant 
influence psychology has as the primary source of knowledge 
for education research. Elementary education and guidance 
are in the mainstream of education literature while higher 
and general education are not. Science education and special 
education are compact, self contained subfields having few 
connections with other education literature. 

Two-step citation maps linked each journals with the 
two journals it cites most frequently. The citation chains 
formed sub fie Id maps showing the interrelationships between 
different graphic clusters of journals. A cluster analysis, 
using all of the citations from each journal, confirmed the 
subfield clusters generated by the graphic methodology. 

Hierarchies were constructed illustrating dependency 
relationships between the individual journals and between 
clusters of journals. Procedures were developed which iso- 
lated general and subfield core journals, and journals 
peripheral to education. 
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ANALYSIS OF RESEARCH JOURNALS 
AND RELATED RESEARCH STRUCTURE, 
IN EDUCATION 



I. INTRODUCTION 

To expedite the organization, utilization and support of 
education research it is necessary, as fully as possible, to 
understand and empirically demonstrate the structure and inter- 
relationships of the many relevant areas of knowledge. The 
need for such an empirical frame of reference has been pointed 
out for the research scientists, by Guilford:! 

••Any serious investigator, in basic science or in 
technology, finds a good freune of reference very 
helpful. A frame of reference may be as broad 
as a philosophical point of view or as circum- 
scribed as a limited scientific theory... An 
investigator without focused efforts is likely 
to pick away at minor problems, here and there, 
as fancy of the moment dictates or as an oppor- 
tunity comes his way... A good frame of refer- 
ence for an investigator's purpose has three 
important specifications: It should be compre- 
hensive, it should be systematic, and it should 
be empirically based." 

Since the research literature is the fundamental medium 
for reporting research knowledge, it is reasonable to assume, 
a priori, that the structure of the literature in a field will 
reflect the structure of the knowledge in that field. 

In a recently completed OE contract, 2 "Analysis of 
Research Journals, and Related Research Structure, in Special 
Education," hereafter referred to as the Special Education 
report. Computer Horizons investigated the structure of the 
special education research literature, and related it to some 
of the surrounding general education literature, and the sup- 
porting psychology literature. In that study a total of 118 
journals were chosen for inclusion in the analysis by progress- 
ing from a few key special education journals to the journals 
heavily cited by the key journals. In turn, the journals cited 
by the cited journals were surveyed, etc., until the citing 
chains closed upon journals which were already considered, or 
were clearly out of the field of interest. Of 79 journals in 
the final sample 19 were classified as special education, 26 
as general education, and 34 as psychology. 
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It was found that there is a much stronger tie from 
special education to psychology than from special education 
to general education. It appears that general education and 
special education are both dependent on psychology, and rela- 
tively independent of one another. The referencing structure 
of general education is highly dispersed, that of special edu- 
cation seems to be somewhat less highly dispersed, and that of 
psychology not nearly as dispersed. 

Thus the previous study has established the feasibility 
of using the structure of the special education research liter- 
ature to gain insight into the structure and importance of re- 
search knowledge. This study builds upon the previous one by 
expanding the data base to include all education areas and 
journals of general significance. The analysis was also de- 
veloped further through the extension of the mapping techniques, 
the automatic identification of core journals, and through 
journal cluster analysis. 



TI. BACKGROUND 



The study of the scientific literature has been ongoing 
for more than fifty years. Work has often aimed toward un- 
covering data useful for science policy purposes; it has also 
been pursued in response to the esthetic challenge of under- 
standing the scientific mosaic* 

One of the first papers based on significant statistical 
data was Cole and Bales 1917 analysis of the comparative anat- 
cmy literature, as it existed from 1550 to 1860*^ A few years 
later, in 1923, Hulme published an analysis of the author en- 
tries in "The International Catalogue of Scientific Literature,"^ 

Both Cole and Bales work, and that of Hulme, were based 
on publications. The first paper analyzing citations, as 
opposed to publications, was that of Gross and Gross in Science 
in 1927.^ Following Gross and Gross's paper there was a burst 
of papers, often authored by science librarians, attempting to 
define the importance and dispersion of various segments of the 
scientific literature, usually from the viewpoint of specific 
disciplines or subdisciplines 

After this burst of papers in the early 1930 's the field 
became quiescent, and stayed so through the war years. Bradford's 
key work in 1934, measuring the spread of papers for a given 
subject, became the base for much post war research .'^ In the 
1950 's there was a gradual reemergence of analysis of the liter- 
ature, as science became large in the 1960 's, and the problems 
of managing a large and rapidly growing enterprise became sig- 
nificant. Bvidence for the growing importance of the subject 
was the appearance of Derek Price's books. ^ 

The communications systems of science also became subjects 
of scholarly study. Cole and Cole looked at the output of jour- 
nal papers, and scholarly recognition. 9 Crane^O and Zukerman 
and MertonH looked at the selection of articles for journals, 
and Garveyl2 and others have looked at the whole range of commu- 
nications activities in the physical and social sciences. 

The inner structure of technical literature also became 
a subject for scholarly investigation. Xhignesse and Osgood^^ 
looked at cross citing, and graphical techniques, for the psy- 
chology literature. Van Cott and Zavala^^ attempted to factor 
analyze the physics literature, and Kessler^S studied citations 
in the same subject area. Stevens^^ and Hagstroml^ measured 
• differences between the characteristics of the literature in 
different fields. Finally, we very recently published a paper 
on the structure of the special education literature. 18 
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Thus there has been extensive work on the sizQ and char- 
acteristics of the technical literature. We have gone a step 
farther, in the research reported here, in analyzing and giving 
structure to the education literature. 

In the next section we describe our methods of data gath- 
ering. Subsequent sections sununarize our results through map- 
ping, cluster analysis, and identification of core journals 
and set forth our conclusions based on those results. 



III. DATA ACQUISITIONS 



The basic data in this report are citations to and from 
a journal. By citations to a journal A we mean all the indi- 
vidual references to articles in journal A from other journals 
B, C, etc., in our set. Similarly, citations from journal A 
are all references from articles in journal A to articles in 
all other journals, books, magazines, newspapers and the like. 
So, by definition, citations-to refers to journal citations 
only, while journal citations are only a part of citations- 
from. Often, however, we will speak of citations to and from 
the journal set; all citations in that context are journal 
citations. 

We hoped, when adding new journals, to only include 
journals which contained 500 journal citations within a five 
year time span; this criterion for scholarliness was established 
in the Special Education study as a minimuiu indicator of tech- 
nical respectability for education journals. In this study we 
found that a five year span was insufficient to obtain 500 jour- 
nal citations from most of the education journals covered in the 
earlier report. Therefore, the standards were relaxed to 500 
citations of any kind over five years, or cm average of 100 
citations per year. Citations were then tabulated until 500 
journal citations, or five years of the journal were covered, 
whichever came first. Taible 1 lists all journals included in 
this study. Note that many psychology journals are included, 
since they are very heavily cited by education journals. 

All of the journals used in the Special Education report 
were also included in this study, as were all education and 
special education journals scanned but rejected in the earlier 
study, which satisfied the more relaxed criteria used here. 

New journals were added in other ways. All periodicals 
cited five times or more by any single journal in our sample 
were noted and scanned on the criteria above. Any journal so 
cited that contained the requisite number of citations, and 
was not out of the field of education, was then included in 
the sample and those journals it cited five times or fnore be- 
came eligible for the same scrutiny. 

A publication was considered to be out of the field of 
education if it primarily cited books and periodicals in other 
disciplines. Table 2 lists journals considered to be out of 
the field of education, in that sense. The two journals re- 
ferred to most often by a journal in our set received top 
priority in this phase of data gathering. 
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TABLE 1 
ALL INCLUDED JOURNALS 



Abbreviation 



Journal Name 



Acad Ther 
Alb J Ed R 
Am Ann Deaf 
AAUP Bull 

Am Bio Te 
Am Ed Res J 
Am J M Def 
Am J Or t hop 
Am Psych 
Arit Teach 
Art Educ 
A V Com Rev 
A V Instr 
Beh Res The 
Br J Ed Psy 
Cal J Ed Res 
Cath Ed R 
Cath Sch J 
Child Dev 
Childh Ed 
Children 
Clear Hse 



Academic Therapy 

Albert r..^x of Educational Research 
American Annals of the Deaf 

American Association of University Professors 
Bulletin 

American Biology Teacher 

American Educational Research Journal 

American Journal of Mental Deficiency 

American Journal of Orthopsychiatry 

American Psychologist 

Arithmetic Teacher 

Art Education 

Audiovisual Communications Review 

Audiovisual Instruction 

Behaviour Research and Therapy 

British Journal of Educational Psychology 

California Journal of EdUv^rational Research 

Catholic Education Review 

Catholic School Journal 

Child Development 

Childhood Education 

Chi Idren 

Clearing House 



ERIC 



TABLE 1 (Continued) 
ALL INCLUDED JOURNAI.S 



Abbreviation 



Journal Name 



Coll Univ 
Comp Ed Rev 
Con temp Ed 
Counsl Ed 
Ed Admin Q 
Ed Leader 
Ed Psy Meas 
Ed Theory 
Educ Forum 
Educ Hor 
Educ Record 
Educ Res 
Educ Tech 
Education 
El Sch Guid 
Elem Eng 
Elem Sch J 
Excpt Child 
G R Ed R D 

Gif Child Q 
Harv Ed Rev 
High School 
Imp Col U Te 



College and University 
Comparative Education Review 
Contemporary Education 
Counselor Education and Supervision 
Educational Administration Quarterly 
Educational Leadership 

Educational and Psychological Measurement 

Educational Theory 

Educational Forum 

Educational Horizons 

Educational Record 

Educational Research 

Educational Technology 

Education 

Elementary School Guidance and Counseling 
Elementary English 
Elementary School Journal 
Exceptional Children 

Graduate Research in Education and Related 
Disciplines 

Gifted Child Quarterly 
Harvard Educational Review 
High School Journal 

Improving College and University Teaching 
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TABLE 1 (Continued) 
ALL INCLUDED JOURNALS 



Abbreviation Journal Name 



Int Rev Ed International Review of Education 

Integ Ed Integrated Education 



J 


Abn Psych 


Journal 


of 


Abnormal and Social Psychology 


J 


Acoust So 


Journal 


of 


the Acoustical Society of America 


J 


Am Stat A 


Journal of the American Statistical 
Association 


J Appl Beh 


Journal 


of 


Applied Behavior Analysis 


J 


Appl Psyc 


Journal 


of 


Applied Psvcholoav 


J 


Clin Psyc 


Journal 


of 


Clinical Psychology 


J 


Col Pers 


Journal 


of 


College Student Personnel 


J 


Com Physl 


Journal of 
Psychology 


Comparative and Physiological 


J 


Cons Clin 


Journal 


of 


Consulting and Clinical Psychology 


J 


Coun Psyc 


Journal 


of 


Counseling Psychology 


J 


Creat Beh 


Journal 


of 


Creative Behavior 


J 


Ed Admin 


Journal 


of 


Educational Administration 


J 


Educ 


Journal 


of 


Education 


J 


Educ Meas 


Journal 


of 


Educational Measurement 


J 


Educ Psyc 


Journal 


of 


Educational Psychology 


J 


Educ Res 


Journal 


of 


Educational Research 


J 


Exp Child 


Journal 


of 


Experimental Child Psychology 


J 


Exp Educ 


Journal 


of 


Experimental Education 


J 


Exp Psych 


Journal 


of 


Experimental Psychology 


J 


Gen Ed 


Journal 


of 


General Education 
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TABLE 1 (Continued) 
ALL INCLUDED JOURNALS 



Abbreviation 



Journal Name 



J Higher Ed 
J Learn Dis 
J Ment Def 
J NAHDC 

J Negro Ed 
J Nerv Ment 
J Pers 
J R Dev Ed 

J Read Spec 
J Reading 
J Reh Deaf 
J Rehab 
J Res Mus Ed 
J Res Sci 
J Sch Heal 
J Sch Psyc 
J Sec Educ 
J Soc Psyc 
J Sp He Di 
J Sp Ke Re 
J Spec Ed 
J Teach Ed 



Journal of Higher Education 

Journal of Learning Disabilities 

Journal of Mental Deficiency Research 

Journal of the National Association of Women's 
Deans and Counselors 

Journal of Negro Education 

Journal of Nervous and Mental Disease 

Journal of Personality 

Journal of Research and Development in 
Education 

Journal of the Reading Specialist 
Journal of Reading 

Journal of Rehabilitation of the Deaf 

Journal of Rehabilitation 

Journal of Research in Music Education 

Journal of Research in Science Teaching 

Jourr al of School Health 

Journal of School Psychology 

Journal of Secondary Education 

Journal rf Fecial Psychology 

Journal of Speech and Hearing Disorders 

Journal of Speech und Hearing Research 

Journal of Special Education 

Journal of Teacher Education 
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TABLE 1 (Continued) 
ALL INCLUDED JOURNALS 



Abbreviation 
J Vrb Lrn 
Jr Col J 
Lang Lrn 
Liberal Ed 
Math Teach 
Mei Pal Q 
Ment Hyg 
Ment Ret 
Mod Lang J 
Mus Ed J 
NASSP 

Nat Elem Pr 
New Outlook 
Pea J Ed 
Perc Mot Sk 
Perc Psych 
Pers Guidan 
Phi Del Kap 
Psyc School 
Psych Bull 
Psych Repts 
Psych Rev 
Psychomet 



Journal Name 



Journal of Verbal Learning and Verbal Behavior 

Junior College Journal 

Language Learning 

Liberal Education 

Mathematics Teacher 

Merrill-Palmer Quarterly 

Mental Hygiene 

Mental Retardation 

Modern Language Journal 

Music Educator's Journal 

National Association of Secondary School 
Principals Bulletin 

National Elementary Principal 

New Outlook for the Blind 

Peabody Journal of Education 

Per^jeptual and Motor Skills 

Perception and Psychophysics 

Personnel and Guidance Journal 

Phi Delta Kappan 

Psychology in the Schools 

Psychological Bulletin 

Psychological Reports 

Psychological Review 

Psychometrika 
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TABLE 1 (Continued) 
ALL INCLUDED JOURNALS 



Abbreviation 



Journal Name 



Psychonom S 
Q H Ed Neg 

Read Res Q 
Read Teach 
Record 
Reh Couns B 
Rel Educ 
Res Quart 
Rev Ed Res 
Sch Rev 
Sch Sci Mat 
Sch Soc 
Sci Child 
^ci Educ 
Sci Teach 
Sightsaving 
Soc of Educ 
Social Ed 
Spec Educ 
St Art Ed 
St Phil Ed 
TESOL Q 



Psychonomic Science 

Quarterly Review of Higher Education Among 
Negros 

Reading Research Quarterly 

Reading Teacher 

Record 

Rehabilitation Counseling Bulletin 

Religious Education 

Research Quarterly 

Review of Educational Research 

S-^hool Review 

School Science and Mathematics 

School and Society 

Science and Children 

Science Education 

Science Teacher 

Sight-Saving Review 

Sociology of Education 

Social Education 

Special Education 

Studies in Art Education 

Studies in Philosophy and Education 

TESOL Quarterly 
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TABLE 1 (Continued) 
ALL INCLUDED JOURNALS 



Abbreviation 


Journal Name 


Theory Prac 


Theory Into Practice 


Tran Sch B 


Training School Bulletin 


Urb Educ 


Urban Education 


Voc Guid Q 


Vocational Guidance Quarterly 


Volta Rev 


Volta Review 


Yng Child 


Young Children 



12 



TABLE 2 



JOURNALS INVESTIGATED AND CLASSIFIED 
OUT OF THE FIELD OF THIS STUDY 



Journal 


Issues /Yr 


Re f s /Yr 


Journal of Chemical Education 


12 


2400 


Journal of Legal Education 


5 


911 


Journal of Medical Education 


11 


891 


History of Education Quarterly 


4 


825 


Hispania 


4 


536 


Speech Teacher 


4 


436 


Journal of Home Economics 


10 


373 


Journal of Dental Education 


4 


36? 


Adolescence 


4 


33] 


Journal of Education for 






Librarianship 


4 


158 


College English 


8 


154 


Journal' of Business Education 


8 


119 


Industrial Arts and Vocational 






Education 


10 


117 



The journal set expanded rapidly at first, but just as 
quickly began to close in on itself as had the journal set in 
the Special Education report. In the end, we found fewer and 
fewer journals of wide circulation with more than our minimum 
number of citations, 100 per year, that could be called educa- 
tion journals. In this later stage most journals scanned were 
either out of the field or little more than glorified trade 
journ^als. 

Finally, to insure that we had not missed any important 
journal in the field of education we consulted Camp's Guide to 
Periodicals in Education . Any journal listed there as relat- 
ing primarily to education, not already covered, was scanned 
and included if it had at least 100 citations to journals or 
books per year, and a reasonably wide circulation. Table 3 
lists all the journals in our sample, ranked by number of cita- 
tions per year. 

Note that there are a few journals that are close to the 
cutoff point of 100 citations per year. Sightsaving Review was 
included in this study, although it did not strictly meet the 
criteria, because it was included in the previous study. 

A list of those journals we investigated carefully but 
which did not satisfy our criteria, may be found in Table 4. 
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TABLE 3 

ALL INCLUDED JOURNALS RANKED BY REFERENCES/YEAR 



Journal 



No. 

Refs. 



J Exp Psych 4500 

J Com Physl 4320 

Psych Rep 4000 

Psychon Sci 3684 

J Abn Psych 3627 

Perc Mot Sk 3500 

Rev Ed Res 2780 

Psych Bull 2205 

Perc Psych 1965 

J Spec Ed 1942 

J Cons Clin 1650 

Am J Me Def 1500 

J Vrb Lrn 1498 

J Couns Psy 1317 

J Exp Child 1300 

J Am Stat A 1272 

Am Psych 1264 

Am J Orthop 1250 

Br J Ed Psy 1113 

J Soc Psyc 1090 

J Nerv Ment 1084 

J Sp He Re 1075 

J Ed Psyc 1051 

Child Dev 1000 

Res Quart 991 

Elem Eng 953 

Psych Rev 944 

J Appl Psyc 895 

J Clin Psyc 84 3 

Sch Rev 820 

Mer-Pal Qu 810 

J Ed Res 800 

J Pers 791 

Beh Reh The 720 

J Negro Ed 719 

Excep Child 715 

Ed Theory 691 

Psyc School 672 

Ment Hyg 629 

J Acous Soc 600 

J Sch Heal 584 

Psychomat 581 

Social Ed 572 

Ment Ret 564 

Sci Ed 559 

Cath Ed Rev 557 

J Sch Psyc 555 





No. 




No. 


Journal 


Refs. 


Journal 


Refs 


Phi Del Kap 


555 


Art Educ 


255 


J Exp Educ 


552 


St Phil Ed 


251 


J Res Sci 


552 


Education 


250 


J Col Pers 


549 


NASSP Bull 


244 


Rel Educ 


539 


J Reading 


242 


Read Teach 


536 


Childh Ed 


239 


Pers Guidan 


531 


Nat El Prin 


239 


J Ment Def 


525 


Tran Sch B 


237 


J Learn Dis 


509 


Acad Ther 


232 


Ed Psy Meas 


506 


G R Ed R D 


230 


Ed Res J 


500 


Clear Hse 


228 


Cath Sch J 


468 


Ed Sch Guid 


226 


J R Dev Ed 


457 


Am Ann Deaf 


221 


Am Bio Te 


450 


J Read Spec 


219 


Soc of Ed 


444 


Cal J Ed Re 


216 


Sch Sci Mat 


435 


Con temp Ed 


215 


A-V Com Rev 


431 


Mus Ed J 


209 


Educ Tech 


430 


Urb Educ 


208 


Elem Sch J 


424 


Yng Child 


206 


Arit Teach 


419 


J Ed Admin 


205 


Read Res Qu 


408 


Gift Child 


205 


Record 


404 


Col Univ 


204 


J Teach Ed 


400 


Pea J Ed 


203 


Comp Ed Rev 


400 


Educ Rec 


197 


J Appl Beh 


393 


Reh Couns B 


196 


J Sp He Di 


392 


J Reh Deaf 


195 


Sci Teach 


391 


J Sec Ed 


188 


Math Teach 


381 


Lang Lrn 


183 


Imp Col U Te 


371 


AAUP Bull 


174 


Har Ed Rev 


354 


J NAWDC 


174 


Voc Quid Q 


339 


Stud Art Ed 


167 


J Creat Beh 


332 


A V Instr 


165 


Mod Lang J 


320 


Children 


160 


Alb J Ed Re 


320 


J Gen Ed 


156 


Ed Leader 


318 


Educ Hor 


153 


Volta Rev 


312 


New-Outlook 


150 


Theory Prac 


304 


Jr Col J 


149 


High School 


300 


J Higher Ed 


146 


Sch Soc 


298 


Integ Educ 


144 


Couns 1 Ed 


292 


Lib Educ 


143 


J Educ Meas 


288 


Sci Child 


141 


J Educ 


285 


J Rehab 


138 


Ed Admin Q 


272 


TESOL Qu 


128 


J Re Mas Ed 


271 


Int Rev Ed 


103 


H Ed Negro 


265 


spec Ed 


102 


Educ Res 


258 


Sightsaving 


75 


Educ Forum 


255 
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TABLE 4 



EXCLUDED JOURNALS WITH LESS THAN 
100 REFERENCES PER YEAR 



Journal 


Issues/Yr 


Refs/Yr 


American Education 


10 


0 


American School and University 


12 


0 


American School Board Journal 


12 


0 


Arts and Activities 


10 


0 


Bulletin on International Education 


10 


0 


College and University Bulletin 


14 


0 


College and University Business 


12 


0 


Educational Digest 


9 


0 


Educational Panorama 


4 


0 


Grade Teacher 


9 


0 


School and Community 


9 


0 


School Arts Magazine 


10 


0 . 


American Teacher Magazine 


4 


1 


Journal of American Indian Education 


3 


6 


NEA Journal 


9 


8 


Home Study Review 


4 


15 


Instructor 


10 


16 


Adult Education 


4 


18 


Adult Jewish Education 


1 


19 


National Catholic Educational 




Administrators Bulletin 


4 


24 


School Activities 


9 


27 


University College Quarterly 


4 


30 


Educational Screen and AV Guide 


12 


31 


NEA Research Bulletin 


4 


37 


School Shop 


10 


39 


Lutieran Education 


9 


47 


Educational Perspective 


4 


59 


Reading Improvement 
Nation's Schools 


3 


59 


12 


60 


College and University Journal 


4 


75 


American Vocational Journal 


10 


86 


Independent Schools Bulletin 


4 


87 


American Music Teacher 


6 


89 
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Though all of the periodicals in Tc^Dle 4 are cited by journals 
in our sample, some of them more than five times by a single 
journal, not one of them gives 100 citations per year and so 
none were included in our sample. Numerous other journals 
were rejected, informally, because they were of very limited 
circulation (such as most state education journals) or obvi- 
ously did not meet the subject or referencing criteria. 

The citation data for all of the new journals was hand 
gathered from the journals as they were found in ♦■.he University 
of Chicago Library system. The issues covered were within the 
time period, 1965-1969, and varied from as high as 40 for the 
Junior College Journal to as few as six for the Merrill-Palmer 
Quarterly . The raw data from the Special Education report was 
reanalyzed to maintain a consistent data base for the entire 
140 journal sample, since citations to the newly added journals 
had to be included in the analysis. 
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IV. TWO-STEP MAPS 



The citation data was used to construct a two-step map 
of the journal structure in the field of education. Figure 1 
illustrates how two-step maps are built. If journal A cites 
journals B and C more often than any other journal, then 
journals B and C receive arrows from journal A. Self citation 
is not included; that is, a journal cannot receive an arrow 
from itself. B, in turn, gives arrows to C and D, while C 
gives them to A and E. By connecting these arrows for the 
entire journal set so as to minimize crossing arrows, a map 
of a field is obtained. As Figures 2 to 11 show, once this 
is done similar journals group themselves together. 




FIGURE 1 - TWO-STEP MAP-MAKING 



Journals grouped themselves together around general 
topics so well that we will refer to the groups as graphic 
clusters. 

Figure 2 then shows a cluster of special education jour- 
nals, and clearly pinpoints the importance of the American 
Journal of Mental Deficiency and Exceptional Children , Sub- 
groupings of journals related to speech and hearing can be 
seen toward the lower center of the figure. Journal names in 
parentheses are journals not included in the sample. Journal 
names not enclosed are journals included in other graphic 
clusters. Note that most of the off map journals receiving 
arrows are psychology and/or medical journals - demonstrating 
the importance of these fields to special education. 

The child development cluster, Figure 3, is named for its 
most important journal, Child Development . Its links to psy- 
chology are apparent in the arrows it gives to psychology 
journals. Despite giving nearly half of its arrows to journals 
outside of its cluster it clearly has a centrally focused 
structure . 

Guidance, Figure 4, has an interesting three-leveled 
structure. The Personnel and Guidance Journal is firmly at 
its core but just as firmly underlying it is the J ournal of 
Counseling Psychology . Loosely lying on top of this structure 
IS a group of lightweight education journals with Phi Delta 
Kappan at their center. The internal structure of this graphic 
cluster is very similar to that of education as a whole. 

Figure 5, the clinical psychology graphic cluster, has 
one center, the Journal of Abnormal and Social Psychology . 
That journal is one of the most important in our journal set 
as is obvious from the number of arrows leading to it. Yet 
there are three distinct sub-groups to be found in the upper 
right, lower right, and lower left sections of this map. On 
the left is a set of layman-oriented journals; American 
Psychologist is the most well known of these. On the lower 
right is a group of mathematics oriented "measurement" jour- 
nals. This subgroup links clinical psychology to bordering 
mathematical areas. The journals on the upper right of the 
cluster are aimed more at the practicing psychologist. 

Experimental psychology is the most self contained of 
all the graphic clusters of journals. Figure 6 shows that 
seven of the eight journals in the group give an arrow to the 
cluster's central journal, the Journal of Experimental Psychology , 
and only four arrows are not given to journals in the cluster. 
Three of those four go to journals not covered in this study 
because they are not education oriented journals, and the other 
goes to the Journal of Abnormal and Social Psychology . Yet 
2-1/2 times that number of arrows are given to this cluster by 
other journals in our set. 
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FIGURE 4 - GUIDANCE GRAPHIC CLUSTER 
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Educational psychology. Figure 7, is a cluster with a 
single dominant journal, the Journal of Educational Psychology , 
which gives this graphic cluster its central focus. In addi- 
tion it has two subgroups linking it to other lines of thought. 
In the upper right corner of Figure 7 are a number of journals 
linking educational psychology with special education and clin- 
ical psychology while other journals in the lower section of 
Figure 7 provide links to the social sciences and guidance. 

The graphic cluster labeled elementary education and 
research. Figure 8, shows a surprisingly coherent internal 
structure with the research element sitting below those jour- 
nals devoted primarily to elementary education. Only three 
arrows are to journals outside of our sample and two of those 
go well out of education while the other is to a widely used 
trade journal, the NEA Journal , that we scanned, but found to 
have far too few citations to be included in our journal set. 
Because the NEA Journal was cited so often by journals in this 
cluster it was nonetheless considered part of the cluster for 
mapping purposes and therefore receives, for the cluster, two 
arrows from other graphic clusters. 

Higher and general education is the most dispersed of 
all our graphic clusters. As Figure 9 shows it has three major 
epicenters and one minor one. The minor, and one of the major 
centers are journals that are not part of our sample because 
they cannot be considered educational journals. Despite their 
lack of close contact with each other, each subgroup is itself 
fairly well defined; that is particularly true of the higher 
education subgroup. Yet were it not for single links, each of 
these centers might be considered a separate cluster. 

Figure 10, science and science education, is an essentially 
self contained cluster, with only one arrow leading out to 
another graphic cluster. Yet the cluster's central journal. 
Science , is not an education journal, but a journal of 
diverse topics with articles of general interest, as well as 
biochemistry and space sciences. Science , not the other jour- 
nals in the cluster, is the recipient of all the arrows to the 
cluster. Science is no less an integral part of that cluster 
for not being an education journal; however the central position 
of another journal. School Science and Mathematics , more than 
makes up for that deficiency. 

The last graphic cluster. Figure 11, shows small groups 
of journals in rather specialized areas. 

A further organizational step may be made by constructing 
a two step group map, composed of boxes representing each of 
the major groups of journals in Figures 2 through 10. In the 
group map the only arrows shown are those from journals in one 
group to journals in 2mother group. All arrows to and from 
journals within a single group are removed. Thus the map shows 
the relationship between groups. 
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Figure 12, the frontispiece, is such a group map. A 
remarkably well structured picture of the field of education 
is drawn. Note that in Figure 12 the direction of the arrows 
is generally down, towards clinical and experimental psychology. 
This indicates that journals in educational psychology, child 
development, and the other graphic clusters cite psychology 
journals far more often than they cite journals in those clus- 
ters. This suggests that the structure of research in education 
is based on psychology and information in education is drawn 
froia that base. 

Of the 256 arrows from the 128* journals on the group 
two-step map only one*fifth lead out of their clusters into 
other clusters. This shows how well structured and closed the 
clusters of journals are. Further, nearly half, 24 of 51, of 
those arrows lead into clinical and experimental psychology, 
reemphasizing the primacy of psychology in education. 

Of the other clusters the science and science education 
cluster is particularly self sufficient, perhaps because it 
has its own body of research in the sciences upon which it can 
drav»« 

Two other graphic clusters, special education and higher 
and general education, have only one arrow given to them, sug- 
gesting that they are not widely used by other education groups. 
The internal structure of the subfields clarifies that point. 
Essentially, special education, as a well ordered subfield, 
closes primarily on its own members. Higher and general educa- 
tion, with its multipoler internal structure, may serve as a 
link between education and the social sciences and humanities, 
and consequently only as a secondary source of data for educa- 
tion. 

Elementary education and research interacts heavily with 
guidance but has a one-way dependency upon educational psychol- 
ogy and research. The educational psychology and r.esearch 
cluster is the central link for elementary education, child 
development, guidance, and experimental and clinical psychology! 
serving as a primary source of information for elementary edu- 
cation, and gathering information from the rest. Guidance is 
a well-structured bridge between much of educational research 
and psychology, as its central position in the model demonstrates. 



*The twelve journals in the all other map. Figure 11, are not 
included on the group map because they are so specialized 
they give no 1st or 2nd arrows to other journals in our set. 
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FIGURE 12 - TWO-STEP MAP OF SUBFIELDS OF EDUCATION JOURNALS 
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Child development serves as a conduit connecting other 
journals cuid their clusters to clinical psychology. In turn, 
clinical psychology is the recipient of most of education's 
references to psychology, and itself refers directly to ex- 
perimental psychology* Only special education, child devel- 
opment, and educational psychology of the other graphic 
clusters refer directly to experimental psychology. 
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V. CLUSTER ANALYSIS 



While the two step maps reveal much about the structure 
of the education literature, they make use of only a fraction 
of the available data, since they utilize only the citations 
to the first and second most frequently cited journals. To 
overcome this limitation a rather complex cluster analysis 
procedure has been developed for generating clusters of jour- 
nals, based on all of the citations to and from each journal ,20 
In essence the cluster analysis groups together journals which 
both highly cite each other and resemble each other in their 
citing patterns to other journals. 

Our general approach to the cluster analysis was that 
of partitioning the journals into a set of clusters on the 
basis of a similarity measure and then checking that each 
journal is in the best cluster by performing hill-climbing 
passes on the clusters until a measure of the quality of the 
clusters was optimized. 

The basic data for the cluster analysis was a 140 x 140 
matrix containing the percentages of references each journal 
gave to every other journal in the set. Table 5 shows a por- 
tion of the matrix. 



TABLE 5 

A PORTION OF THE STANDARD MATRIX 
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Basically two types of similarity measures were tried: 



r 

r 



1. 



Euclidean distance measures, in which the 
percents of citations from journal to journal 
were the data, and 



2. 



Rank correlation measures, in which the rank 
orders of most cited journals were the data. 



For the measure of quality of clustering, several were tried, 
some based on the various similarity measures and some based 
on the original data. Various combinations of similarity 
measures and clustering quality measures were tried, all giv- 
ing somewhat different results. Most gave quite reasonable 
clusters but no method was outstanding and no absolute measure 
of the quality of the final clusters could be chosen. The 
assumption was then made that the final clusters would be con- 
structed from journals which cluster together on several of 
the methods. For a more complete discussion of the cluster 
analysis method the reader is referred to a paper we are now 
writing on the subject. 21 

Table 6 shows the clusters, of education journals derived 
by the cluster analysis. 

Note how easy it was to label the clusters. In fact, 
the similarities between this cluster analysis, and the graphic 
clusters are so great that comparison of the graphic clusters 
with similar groups of these clusters reveal 108 common jour- 
nals. Seventy- seven percent of the 140 journals in our sample 
are grouped similarly by two different methods. Table 7 shows 
two exami>les. 

Another important result of the cluster analysis is a 
cluster cross-referencing matrix, which shows the patterns 
of citation by clusters, rather than by individual journals. 
Figure 13-A is a two-step map made from the cluster cross- 
referencing matrix foi the graphic clusters.* Figure 13-B is 
a similar map constructed from the cluster analysis cross- 
referencing matrix. Solid arrows show the most frequently 
cited clusters, dotted the next most frequently. A comparison 
of the maps shows the strong similarity between the graphic 
clusters and the cluster analysis clusters in their pattern of 
cross cluster citation. 

So here again it is apparent that the field of education 
is well structured, and that the structure is easily discerned 
through r mination of the oatterns of journal cross referencing. 

•Note "Educational Psychology and Child Development receive an 
equal percentage of citations from Clinical Psychology so both 
are given second arrows by it. Educational Psychology gives 
second arrows to both Experimental Psychology and Elementary 
Education for the same reason. 
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TABLE 6 
CLUSTER ANALYSIS CLUSTERS 
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TABLE 6 (Continued) 
CLUSTER ANALYSIS CLUSTERS 
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FIGURE 13 - TWO-STEP CLUSTER MAPS 
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VI. HIERARCHIES 



A further means of showing the orderliness and dependency 
relations in the education literature is through construction 
of hierarchies, in which heavily cited journals or clusters lie 
toward the base. Three major hierarchies were constructed. 
Figure 14 shows a hierarchy of graphic clusters. Figure 15 a 
hierarchy of clusters derived from cluster analysis, and Fig- 
ure 16 shows a detailed hierarchy of individual journals. 

Figures 14 and 15 clearly show that psychology forms the 
base of educational research. In these hierarchies a cluster A 
is placed above a cluster B, if cluster A gives cluster B a 
higher percentage of its total citations than B gives A. The 
hierarchies are fully transitive; if C is above D, art 0 is 
above E, then C is cUt^ove E and almost always all of the rela- 
tionships C/0, 0/E, and C/E are satisfied. Therefore we see, 
in Figure 15, that the cluster IsUbeled "Psychology and Child 
Development" is referred to a larger percentage of the time by 
all of the other 2^ clusters, than it refers to any of them. 
Similarly the clusters labeled "Experimental Psychology** and 
"Clinical Psychology" in Figure 14 are at the base of its 
hierarchy. 

If at least one of a pair of clusters refers to the 
other at least 1 percent of the time the relationship is con- 
sidered significant. Conflicts arise when the citations a 
cluster G gives one cluster H should place it above H, yet 
cluster I, which is below H, gives G enough citations to 
warrant placing G below I. Since cluster G must be placed 
somewhere a conflict results when it is placed. The conflict 
is a significant conflict only if conflicting clusters differ 
in their citing of each other by more than 1 percent. 

The individual journal hierarchy also shovs psychology's 
preminence in education. At the base of the hierarchy are 
psychology journals; all of the first 11 journals on the trunk 
of the hierarchy are psychology journals belonging to the 
experimental and clinical psychology clusters in the two-step 
maps . 

Branches on the hierarchy also reflect the structure 
developed in the two-step maps and cluster analysis clusters. 
Branches are formed by simply pulling out of the main stem 
those journals which bear close relationships to each other. 
But any journal on a branch can be placed back on the main 
stem without altering the order of the hierarchy. Let us 
take the placing of the journal Phi Delta Kappan as an illus- 
trative example: Phi Delta Kappan appears on a branch emanat- 
ing from Review of Education Research . The next highest jour- 
nal on the trunk. School Review , cites Phi Delta Kappan more 
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Rank by Size Cluster 
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45 possible relationships 

42 significant relationships (>^1% at least one way) 
3 insignificant relationships 
no conflicts of any kind 



FIGURE 14 - HIERARCHY OF GRAPHIC CLUSTERS 
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2 


Special Education - Mental Abilities 


12 


Speech-Hearing 


8 


Applied Psychology 


3 


Educational Psychology and Measurement 


1 


Clinical Psychology and Child Development 



253 possible relationships 
214 actual relationships 

124 significant relationships (>^1% at least one way) 
90 insignificant relationships 
1 significant conflict at >1% 
19 insignificant conflicts 



FIGURE 15 - HIERARCHY OF CLUSTER ANALYSIS CLUS'^'^'RS 
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than Phi Delta Kappan cites it, so Phi Delta Kappan belongs 
below It on the hierarchy. Yet Phi Delta Kappan Ts one of a 
group of journals which all give School Review a smaller per- 
centage of their citations than School Review gives them (or 
have no significant relationship with School~Review s) . Therefore 
that group of journals all belong below School Review on the 
hierarchy. In addition, that group of journals - Record , 
Audiovisual Communications Review , Phi Delta Kappan , American 
Association of University Professors Bulletin , Reading Teacher , 
Elementary English , and Elementary School Journal - heavily 
cite each other and Review of Education Research and belong 
above Review of Educitional Research on the hierarchy. Conse- 
quently, to show that they are closely associated, they have 
been placed on a branch. As a general rijile any journal on a 
branch may be considered to occupy the same position with re- 
spect to those journals above it on the hierarchical tree as 
the journal from which its branch emanates, and journals on a 
branch can be considered to be above those further in on the 
same branch. 

Note that near the bottom of the individual journal hier- 
archy the straight line of the main trunk is broken. A branch 
comes off at Psychological Reports , and the trunk continues up- 
ward from the first journal of that branch, the Journal of 
Educational Psychology . This is intended to illustrate the 
structure of the field of education as it has been determined 
through measures we employ in this report. The Journal of 
Educational Psychology is the most oft cited journal in our 
sample; 110 journals of the 140 in our sample give it an aver- 
age of 2.5 percent of their citations. Further, 96 of the 118 
journals remaining when psychology journals are excluded give 
it an average 2.6 percent of their citations, and it is located 
at the center of the educational psychology and research graphic 
cluster. If we view a hierarchy as a tree, the Journal of 
Educational Psychology may be considered the base of education 
research, the eleven psychology journals on the trunk below it, 
its roots. 

The line is not straight at the bottom of the hierarchy 
for a similar reason. The Journal of Abnormal and Social 
Psychology is the second most frequently cited journal in our 
sample even when citations from 22 psychology journals are ex- 
cluded. It is cited by 89 journals at an average rate of 2.3 
percent when psychology citations are excluded, and by 105 
journals at an average of 3.6 percent when they are included. 
In addition it is at the center of the clinical psychology 
graphic cluster. Thus it is pictured in Figure 14 at the base 
of the straight line "root" of the hierarchy. Yet it is depen- 
dent on a more basic journal, the Journal of Experimental 
Psychology , which is also the center of the experimental 
psychology graphic cluster. Only 80 journals give an average 
of 2.6 percent of their citations to the Journal of Experimental 
Psychology when citations from the whole journal set are utilized. 



43 



and 64 journals give only 1.9 percent of their citations to it 
when citations from psychology journals are excluded- As we 
see it is cited by far fewer journals than either the Journal 
of Abnormal and Social Psychology or the Journal of Educational 
Psychology . So we may conclude that the Journal of Experimental 
Psychology is more important to psychology and psychology jour- 
nals than it is to education journals. Though the Journal of 
Experimental Psychology belongs below the Journal of Abnormal 
and Social Psychology on the hierarchy, it is less on the main 
line of educational research, more of a taproot instead, and 
for that reason it has been placed below, but to the side of 
the Journal of Abnormal and Social Psychology . 

There is a journal lower on the hierarchy that the Journal 
of Experimental Psychology , but it is important to only a few 
of the journals in our set. The Journal of Comparative and 
Physiological Psychology has significant relationships with 
only thirteen journals, all of them psychology journals and is 
in conflict with one of them. It receives 1 percent or more 
of the total number of journal citations from only twelve 
journals in our set, gives at least 1 percent of its journal 
citations to only three of those twelve, and gives 2 percent of 
its citations to one other journal in our set. Psychological 
Bulletin , making a total of thirteen separate journals. Unfor- 
tunately the 2 percent citations it gives to that journal put 
it in conflict with three of the other journals it receives 
citations from.* Since the Journal of Comparative and Physio- 
logical Psychology receives a higher percentage of citations 
of those three journals citations than it gives to them, it 
belongs below them on the hierarchy. Yet because it gives 
Psychological Bulletin 2 percent of its citations and receives 
less than 0.5 percent of Psychological Bulletin's citations, 
the Journal of Comparative and Physiological Psychology belongs 
above Psychological Bulletin . To put it above would create 
conflicts with the three journals below Psychological Bulletin 
that belong above the Journal of Comparative and Physiological 
Psychology . So to minimize the conflicts that the placement 
of the Journal of Comparative and Physiological Psychology in 
the hierarchy was bound to create, it was put at the base of 
the hierarchy, putting it in conflict with only one journal, 
and that at less than 2 percent. 

We may say then that because it has significant relation- 
ships with only a few psychology journals, the Journal of 
Comparative and Physiological Psychology is not really part of 
education. So the Journal of Experimental Psychology remains 
the most broadly fundamental journal on this hierarchy of edu- 
cation and related journals. 



*The three journals are Psychonomic Science, Psychological 
Review and Journal of Experimental Psychology. 



Of approximately 1450 significant relationships between 
journals, 21, or 1.5 percent, resulted in conflicts when this 
hierarchy was constructed. That is another, perhaps the best, 
indication that this hierarchy, with psychology journals at 
its base, is a real and well ordered one. 
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VII. PROPOSED CORE JOURNALS 

A series of programs were developed to identify core 
journals, using the standard cross citing matrix. We estab- 
lished three criteria for importance. Measures were assigned 
on the basis of (1) the number times a journal received 1 per- 
cent or more pf another journal's citations, (2) the number of 
times it was cited at all, and (3) the mean of the percent 
level of citations to it from those journals citing it at all. 
Journals were classified into various categories on the basis 
of those measures of journal importance. Categories were de- 
lineated for three different sets of journal citations. 

The first set makes use of all the citations from and to 
all the journals in our sample. The second set uses only cita- 
tions from education journals, to all ths journals in the sam- 
ple. It does not include any citations from psychology journals. 
The third set excludes all references to and from psychology and 
so covers only citations from education journals to education 
journals. Table 8 shows the resulting classification of journals 
into categories. We took as psychology journals all of those 
found in the clinical psychology and experimental psychology 
graphic clusters. Table 9 has these journals. 

Categ ties 1 through 5 represent distance from the core 
of a field tth category 1 at the core and category 5 on the 
periphery. Category 1 contains the core journals. They rank 
highest on at least two of the three measures of journal impor- 
tance used, the number of times the journal was cited at a 
1 percent level or greatei^ by another journal, the number of 
times it was cited at all by another journal, and the mean 
percentage of citations from all those journals citing it. 
Category 2 journals are those near the core; they are heavily 
used, but not quite as much as those at the core. The broad 
middle of the field is found in category 3. Journals in cate- 
gory 3 are cited often, but not often enough; they cite jour- 
nals in categories 1 and 2, and are in turn cited by journals 
in categories 4 and 5 and by each other. In category 4 are 
those journals less frequently cited by other journals in our 
ssunple but still utilized often enough to avoid being consid- 
ered peripheral. The journals of peripheral importance to the 
field are found in category 5. Peripheral journals rank low 
in all of the measures of journal importance mentioned above. 
Many of them are members of subfields but they are not cited 
enough to demonstrate that fact using these measures. 

There are two additional categories as well, category 6 
which identified subfield cores, and category 7, members of a 
subfield. If a journal was cited most often by a small number 
of journals in our sample, while having few relationships with 
the other journals in the sample, it was placed in category 7. 
Category 6 is reserved for those subfield members that are very 
highly cited by those few journals that cite it. 
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TABLE 8 

JOURNAL IMPORTANCE CATEGORIZATION 



Citings From 
All to All 



Citings From 
Ed to All 



Set I 


Set II 




Category 1 - Core Journals 




Ain iroycn 


Child Dev 


Child Dev 


J Abn Psyc 


J Abn Psyc 


J Editc Psyc 


J Educ Psyc 


J Exp Psyc 


Pers Guidan 


Psyc Bull 


Psyc Bull 


Psyc Bull 


Psyc Bull 




• 

Category 2 - Near Core Journals 


Am J M Def 


Am J M Def 


Har Ed Rev 


Har Ed Rcsv 


J Cons Clin 


J Coun Psyc 


J Educ Res 


J Educ Res 


Pers Guidan 


Phi Del Kap 


Psyc Rev 






Category 3 - Mid-Range Journals 


Am J Orthop 


Am J Orthop 


Br J Ed Psy 


Br J Ed Psy 


Education 


Education 


Ed Phy Meas 


Ed Phy Meas 


Elem Sch J 


Elem Sch J 


Excep Child 


Excep Child 


J i^pl Psyc 


J Appl Psyc 


J Clin Psyc 


J Clin Psyc 


J Com Physl 


J Cons Clin 


J Coun Psyc 


J Exp Educ 


J Exp Educ 


J Exp Psyc 


J Pers 


J Teach Ed 


J Teach Ed 


Perc Mot Sk 


J Vrb Lrn 


Psyc Rev 


Perc Mot Sk 


Read Teach 


Psyc Repts 


Rev Ed Res 


Psychomet 


Sch Rev 


Rev Ed Res 


Elem Eng 


Sch Rev 


NASSP 


Elem Eng 




NASSP 




Phi Del Kap 





Citings From 
Ed to Ed 



Set III 



Child Dev 
Har Ed Rev 
J Educ Psyc 
J Educ Res 
Pers Guidan 
Rev Ed Res 



Am J M Def 
J Coun Psyc 
J Exp Educ 
Sch Rev 
Phi Del Kap 



Am Ed Res J 
Am J Orthop 
Br J Ed Psy 
Education 
Educ Res 
Elem Sch J 
Excep Child 
J Exp Child 
J Sp He Di 
J Teach Ed 
Perc Mot Sk 
Read Teach 
Record 
Elem Eng 
Mer-Par Qu 
A V Com Rev 
Sch Soc 
NASSP 
Clear Hse 
Educ Rec 
J Higher Ed 
A V Instr 
Ed Leader 
Arit Teach 
Sch Sci Mat 
Social Ed 



47 



TABLE 8 (Continued) 
I JOURNAL IMPORTANCE CATEGORIZATION 



CitinQs From 




Li *:ings From 


All to All 


I-<U uO All 


Ed to Ed 


Set I 




Set III 


Catecforv 4 


A^wax «cxx^llCXY uOUmclXS 




Am Ed Res J 


/nil CiSA I\69 u 


Educ Forum 


&v w ^ V & 1 w A A ^ 


£<uuw f o£^ wun 


Ment Hyg 


J Soc Psyc 


J Pers 


Psyc School 


Ment Hyg 


J Soc Psyc 


Soc of Ed 


Record 


Psyc Repts 


Cal J Ed Res 


Soc of Ed 


Psychomet 


Nat El Prin 


Mer-Par Qu 


Record 


Childh Ed 


Sch Soc 


Soc of Ed 




Cal J Ed Res 


Mer-Par Qu 




Ed Leader 


Sch Soc 






Clear Hse 






Cal J Ed Res 






Nat El Prin 






Ed Leader 





Children 
Educ Forum 
Gift Child Q 
High School 
J Am Stat A 
J Appl Beh 
J Educ 
J Educ Me as 
J Learn Dis 
J Ment Oef 
J Reading 
J Reh Deaf 
J Sch Heal 
J Sec Ed 
J Sch Psyc 
New Outlook 
Perc Psyc 
Psyc School 
Read Res Q 
Train Sch B 
Yng Child 
J R Oev Ed 
Alb J Ed R 
G R Ed R 0 
El Sch Guid 
J Ed Admin 
Educ Hor 
TESOL Qu 



Category 5 - Peripheral Journals 
Children 
Gift Ciild Q 
High School 
J Am Stat A 
J Appl Beh 
J Educ 
J Educ Meas 
J Learn ois 
J Ment Def 
J Reading 
J Sch Heal 
J Sec Ed 
J Spec Ed 
J Sch Psyc 
New Outlook 
Perc Psyc 
Psyc School 
Train Sch B 
Yng Child 
J R Oev Ed 
Alb J Ed R 
G R Ed P. D 
El Sch Guid 
J Ed Admin 
Educ Hor 
TESOL Qu 
, Int Rev Ed 
^ Pea J Ed 



Am Psych 
Beh Res The 
Ed Phy Meas 
Gift Child Q 
J Abn Psyc 
J Am Stat A 
J Appl Beh 
J Appl Psyc 
J Clin Psyn 
J Com Physi 
J Cons Clin 
J Educ 
J Educ Meas 
J Exp Psyc 
J Learn Ois 
J Nerv Ment 
J Pers 
J Sch Heal 
J Soc Psyc 
J Vrb Lrn 
New Outlook 
Psyc Bull 
Psyc Repts 
Psyc Rev 
Psychomet 
Psychonom S 
Train Sch B 
Yng Child 
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TABLE 8 (Continued) 
JOURNAL IMPORTANCE CATEGORIZATION 



Citings From Citings From Citings From 

All to All Ed to All Ed to Ed 



Set I 

Category 5 
Int Rev e3 
Pea J Ed 
Sci Child 
Lib Educ 
Integ Educ 
J Gen Ed 
J NAWDC 
Urb Educ 
Contemp Ed 
J Read Spec 
Childh Ed 
St Phil Ed 
H Ed Negro 
Theory Prac 
J Great Beh 
Voc Guid Q 
Imp Col U Te 
Educ Tech 
Cath Sch J 
Rel Educ 
Cath Ed R 
Ed Theory 
J Negro Ed 



Set II 

- Peripheral Journals 
Lib Educ 
Integ Educ 
J Gen Ed 
J NAWDC 
Urb Educ 
Contemp Ed 
J Read Spec 
Childh Ed 
St Phil Ed 
H Ed Negro 
Theory Prac 
J Great Beh 
Voc Guid Q 
Imp Col U Te 
Educ Tech 
Cath Sch J 
Rel Educ 
Cath Ed R 
Ed Theory 
J Negro Ed 



S et III 

(Continued) 

J R Dev Ed 
Alb J Ed R 
G R Ed R D 
El Sch Guid 
J Ed Admin 
Educ Hor 
TESOL Qu 
Pea J Ed 
Lib Educ 
Integ Educ 
J Gen Ed 
Urb Educ 
Contemp Ed 
J Read Spec 
St Phil Ed 
H Ed Negro 
Theory Prac 
J Great Beh 
Voc Guid Q 
Imp Col U T 
Educ Tech 
Cath Sch J 
Rel Educ 
Cath Ed R 
J Negro Ed 



Category 6 - Subfield Core Journals 

Am Ann Deal Am Ann Deaf 

J Acoust So Volta Rev 



Acad Ther 
Beh Res The 
Comp Ed Rev 
Counsl EC 
Educ Res 
J Acoust So 
J Exp Child 
J Rehab 
J Res Sci 
J Spec Ed 
J Sp He Di 
J Sp He Re 



Category 7 - Subfield Journals 
Acad Ther 
Beh Res The 
Comp Ed Rev 
Counsl Ed 
Educ Res 
J Com Physl 
J Exp Child 
J Nerv Ment 
J Rehab 
J Reh Deaf 
r Res Sci 
J Sp He Di 



Acad Ther 
Children 
Comp Ed Rev 
Counsl Ed 
High School 
J Acoust So 
J Ment Def 
J Reading 
J Rehab 
J Reh Deaf 
J Res Sci 
J Sec Ed 
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TABLE 8 (Continued) 
JOURNAL IMPORTANCE CATEGORIZATION 



Ci t i ng s From 


Citincrs From 


C i t i net P rnm 

w X W X 1 1^^ 9 X X Will 


All to All 


Ed to All 


4-/^ PrI 
£d\Ji uO uCl 


Set I 


Set II 


Qo^ TTT 


Cateaorv 7 


X X w XVI V WUX iICi X w 




Ment Ret 


J Sd He Ra 

■'4' **w *\c 


.T Qno/^ P/4 


Psychonom S 


J Vrb Lrn 

V T X A# A4X A A 


Ho no 
u ne i%6 


Read Teach 


Ment Hva 


u ocn xrsyc 


Reh Couns B 


Ment Ret 




Res Quart 


Psychonom S 


It csx w iraj^w 


Sightsaving 


Read Res Q 


Rp A d Pfi <t O 

C\C6IU <\69 \£ 


Spec Ed 


Reh Couns B 


Doll C/^itncs P 


Volta Rev 


Res Quart 


PoQ Oii^r"^ 


Sci Educ 


Sightsaving 


S "i cfh"^ sjivi T\a 

I0XM lIi»96IVXI 


A V Com Rev 


Spec Ed 


Snec Ed 

k^^ww UVI 


J Res Mus Ed 


Volta Rev 


Qoi PHii/^ 

OwX CiUUw 


Art Educ 


Sci Educ 


Poo Miics PH 


Clear Hse 


A V Com Rev 


Art Pdiio 


Educ Rec 


k7 Ras Mus Cd 


DuUQ /ix U CiCI 


Stud Art Ed 


Art Educ 


Int Rev Ed 


J Hiciher Ed 


Educ Ret* 


ocx cnxxa 


Jr Cnl J 


Stud Arl- FH 


jr uoi u 


A V Instr 


J Hicrher Ed 




AAUP Bull 


Sci Child 


AATTP Pii1 1 




U X X u 


Liang Lirn 


Coll Univ 


A V Instr 


Coll Univ 


Mus Ed J 


AAUP Bull 


Mus Ed J 


Nat El Prin 


Lang Lrn 


Ed Admin Q 


Ed Admin Q 


Coll Univ 


Mod Lang J 


Mod Lang J 


Mus Ed J 


Math Teach 


Math Teach 


Ed Admin Q 


Sci Teach 


Sci Teach 


Mod Lang J 


Am Bio Te 


Arit Teach 


Math Teach 


J Col Pers 


Sch Sci Mat 


Sci Teach 


Ed Theory 


Am Bio Te 


Arit Teach 


J Col Pers 


Sch Sci Mat 




Social Ed 


Am Bio Te 






J Col Pers 






Social Ed 





ERIC 
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TABLE 9 
PSYCHOLOGY JOURNALS 



J Abn Psyc 


Journal of Abnormal and Social Psychology 


J Soc Psyc 


Journal of Social Psychology 


J Pers 


Journal of Personality and Social Psychology 


J Cons Clin 


Journal of Consulting Clinical Psychology 


J Nerv Ment 


Journal of Nervous and Mental Disorders 


J Clin Psyc 


Journal of Clinical Psychology 


Ed Phy Meas 


Educational and Psychological Measurement 


Psychomet 


Psychometrica 


J Ed Meas 


Journal of Educational Measurement 


J Am Stat A 


Journal of American Statistical Association 


J Appl Psyc 


Journal of Applied Psychology 


Psyc Bull 


Psychology Bulletin 


Psyc Repts 


Psychological Reports 


Am Psych 


American t'sychologist 


•T Creat Beh 


Journal of Creative Behavior 


J Com Phy si 


Journal of Comparative and Physiological 
Psychology 


Psychonom S 


Psychonomic Science 


J Exp Psyc 


Journal of Experimental Psychology 


Psyc Rev 


Psychology Reviews 


J Vrb Lrn 


Journal of Verbal Learning and Verbal Behavior 


Beh Res The 


Behavioral Research and Therapy 


J i^pl Beh 


Journal of Applied Behavioral Psychology 
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It is most important to note in this comparison the 
extraordinary stability of the categories whether citations 
from psychology journals are included, as in Set 1, or excluded 
as in Set 2, In fact, because of the very high self-referencing 
of the psychology journals; experimental psychology cites itself 
and clinical psychology 52, 6 percent of the time and the rest 
of the set only 3.1 percent, the figures for clinical psychology 
are 52.7 percent and 6,7 percent respectively; our best estimate 
of the core and related journals in education is Set 2. Set 2, 
which uses citations frcan the educational journals to the entire 
set, isolates six core journals* 

In order of importance they are: 

1. Journal of Educational Psychology - This journal 
is cited by more journals than any other in each 
set of categories, is the center of a graphic 
cluster, and is chosen as a core journal in all 
three sets of categories. 

2. Child Development is a core journal in each set 
of categories, is at the center of a graphic 
cluster and ranks fifth in the number of jour- 
nals in our sample citing it. 

3. Journal of Abnormal and Social Psychology - 
This is the most heavily used psychology journal 
in our sample. It ranks second in the number of 
journals which cite it, and when citations from 
psychology journals are included, as they are in 
Set 1, it receives more individual citations 
than any journal of any kind in our sample. In 
addition, it is twice identified as a core jour- 
nal and is at the center of a graphic cluster. 

4. Personnel and Guidance Journal - Though referred 
to by fewer journals than the other core journals. 
Personnel and Guidance Journal has the highest 
mean percent citations of the core journals; 
those journals citing it give in an average of 

3 percent of their journal citations. It appears 
as a core journal twice, and in category 2 the 
third time, and is at the center of a graphic 
cluster. 

5. Psychological Bulletin - This journal is referred 
to by the fourth largest number of journals in 
our sample. It links e:4perimental and clinical 
psychology and was twice chosen as a core journal. 

6. Aiqgrican Psychologist - Ranks third in our sample 
in the number of journals citing it. It was 
chosen twice as a core journal. 
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Five of the six journals above were also chosen as core 
journals in Set 1, when citations from all the journals in our 
sample, to all the journals in our sample were used to determine 
the core. In Set 1 the Journal of Experimental Psychology ap- 
peared where the Personnel and Guidance Journal appears in 
Set 2. That is only logical. When citations from psychology 
are included in determining the core of a set of journals the 
center of the experimental psychology graphic cluster should 
gain importance over an education and guidance oriented journal 
such as the Personnel and Guidance Journal . 

The last mentioned journal Personnel and Guidance Journal 
does appear in the core of Set 3 confirming its importance to 
education, inasmuch as Set 3 is built upon references to educa- 
tion journals, from education journals alone. Three new jour- 
nals appear in the core of this set. The Harvard Educational 
Review and Journal of Educational Research were both category 2, 
near-core, journals in the other sets. The third journal. 
Review of Education Research , rose from its position in cate- 
gory 3 in the two other sets of categories of journals. In 
addition both of the first two journals are at the center of 
a graphic cluster while the third is not, all of which suggests 
that reviews of educational research, and by implication educa- 
tional research itself, take a back seat to psychology and 
psychological research and gain importance only when psychology 
is ignored. 

The importance of Table 8 lies not only in category 1, 
the core journals, but in all the categories. We have shown 
the core journals in the field, and gradations of journals out 
from the core to the periphery in a systematic way. In addition. 
Table 8 shows which of our 140 journal sample are subfield 
cores, category 6, as well which journals are primarily members 
of subfields, category 7. Figure 17 illustrates that graphic- 
ally. The area between the circles represents the number of 
journals appearing in each category. We see that the core of 
education is represented by a very few journals. There is a 
broad band of frequently used journals but a far wider one of 
essentially peripheral journals. In addition a large number of 
journals belong to subfields but very few can uneguivacably be 
placed at the core of a tightly knit subfield. 
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FIGURE 17 - THE RELATIVE SIZE OF CATEGORIES OF EDUCATION 
JOURNALS 

54 



VIII. RESULTS AND CONCLUSIONS 



The universe of scholarly journals in education is small ^ 
though highly populated at the edges. The difficulties involved 
in data gathering alone substantiate this conclusion. In order 
to adequately cover the field we were forced to employ a much 
lower standard of scholarliness (100 references per year) to 
the journals than is used for the scientific literature. And 
even then additional safeguards had to be used to insure that 
no journal was overlooked, since the low level of reference 
precludes complete reliance on citations. Our final journal 
san^>le thus included every journal that was highly cited by 
other education journals and could be considered to belong to 
the field of education as well as many that are not centrally 
important. But the signific2mt journals stand out above the 
others. No one could miss Child Development , the Journal of 
Educational Psychology , School Review , or Elementary English , 
But the California Journal of Educational Risearch and Reading 
Teacher are obviously less important to the field. And High 
School and the Junior College Journal , though used often by 
some, are not known to everyone in education. 

The field of education is nonetheless highly structured. 
Two-step maps, cluster cuialysis, hierarchies of clusters and 
of journals, and identification of core journals, all point to 
the Scune structure of well defined subfields resting on a base 
of experimental and clinical psychology. What we have called 
graphic clusters may also be called subfields. We refer back 
to Figure 12 to show what each method of analysis has shown; 
psychology is the main source of commonly accepted knowledge 
in education, Subfields easily define themselves, are obvi- 
ously rdentif icdDle, and are clearly delineated from other siib- 
fields. 

Each of the hierarchies. Figures 14, 15 and 16 show 
psychology journals, or clusters of psychology journals, at 
the roots of education. The Special Education report concluded 
that special education depended primarily on psychology for its 
basic information and referred little to general education. 
This report shows that most of education relies primarily on 
psychology and defines, in addition, the structure of the vari- 
ous subfields of education. 

That these subfields have a definite internal structure 
and relate to each other in a systematic way was made clear in 
the two-step maps section of this report. Figure 12 again 
illustrates the primacy of psychology as the main source of 
information for many journals. Clinical psychology receives 
the most arrows, but gives arrows in turn to experimental 
psychology; both subfields give a single arrow to the journal* 
Science , suggesting that psychology is, in turn, dependent on 
biochemistry and the hard sciences. 
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Educational psychology and research is also a source of 
information, particularly for elementary education and research. 
But educational psychology and, tiirough it and guidance, elemen- 
tary education, also rely directly on clinical and experimental 
psychology. Each of those three subfields, because of their 
heavy interaction with each other and the rest of the subfields, 
are obviously in the mainstream of education research. The 
child development subfield appears to be a conduit to psychology 
for other subfields. The same can be said for the guidance sub- 
field, but there the mech£mism is different. Guidance itself 
contains a number of psychology journals so its link with psy- 
chology is more direct. 

It is interesting to note that two subfields, special 
education, and higher and general education, have only one 
arrow leading into them. The two-step map of the subfields. 
Figures 2 and 9, hint at the reasons for this. The former dis- 
plays a great deal of internal structure, while the latter is 
loose knit with 3 or 4 epicenters. This suggests that special 
education is a self sufficient subfield depending primarily on 
itself and psychology for its source information and thus is 
not a primary source of information for other areas of education. 
Indeed this is a major conclusion of the Special Education report. 

Higher and general education, on the other hand, with its 
highly dispersed, more generalized internal structure, depends 
on sources of data outside of the field of education. Conse- 
quently its publications are not of prime importance to others 
in the field of education because they lack information of a 
purely educational nature. Science and science education, un- 
like the others, is generally self sufficient because it draws 
primarily on scientific research for its information. 

So it can be seen that most of education depends directly, 
or through other subfields of education on psychology, primarily 
clinical psychology, but directly and indirectly through clin- 
ical psychology, on experimental psychology. 

Experimental psychology may be called the tap root of 
educational research. This is borne out by other measures in 
this report. Experimental psychology is at the base of the 
hierarchy of two-step map clusters (Figure 14) . The journals 
in the cluster at the base of the cluster analysis hierarchy 
(Figure 15) are largely experimental psychology journals, as 
are the journals at the base of the individual journal hier- 
archy (Figure 16). In addition it has the second highest ratio 
of citations to it by citations from it; i.e., it receives 
nearly twice as many citations from other subfields as it gives 
to other subfields in this sample. . 

Figure 18 illustrates a number of important points on 
the nature of the field of education. It shows, as histograms. 
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the 1 itio between the citations a subf ield receives from other 
subfields, and the citations from that subf ield to other sub- 
fields. This to/from citation ratio excludes the citations 
each subfield gives to itself so it measures the cross-subf ield 
citing only. Figure 18 demonstrates the use the subfields make 
of each other. The subfield with the highest to/from ratio is 
clinical psychology. This is perfectly reasonable in the light 
of our earlier statements about the importance of psychology to 
education. It is only natural that clinical psychology, which 
deals directly with people, should receive the most citations 
to its work. That this high ratio of citations to/citations 
from results from a high absolute number of citations is shown 
in Figure 19. 

In Figure 19 the solid line shows what percentage of the 
total number of cross-subf ield citations each subfield receives. 
The broken line indicates the percentage of the cross-subf ield 
citations each subfield gives. Cross-subf ield citation includes 
only citations to journals in our set and excludes the citations 
each subfield gives to journals within its own subfield. Here 
clinical psychology is seen to have the highest absolute number 
of citations of any subfield in education. 

Only one cluster other than clinical psychology and 
experimental psychology, higher and general education, has a 
ratio of citations to/citations from greater than 1. That 
higher and general education is cited more often by other sub- 
fields of education than it cites them, is evidence that this 
subfield serves as a link to the social sciences and humanities. 
Information frcxn those disciplines enters the field of education 
through the journals in the higher and general education sub- 
field. It is imperative to note at this time, however, that, 
as Figure 19 illustrates, only 4 percent of the total cross 
subfield citations go to this subfield. This is insignificant 
compared to the 31.8 percent and 22.6 percent of cross subfield 
citations that are received by clinical and experimental psy- 
chology respectively. Though one of the journals in general 
and higher education, the Harvard Educational Review , is a 
centrally important journal in education, the subfield as a 
whole is not of prime importance to educators. 

We also see in Figure 18 three subfields that are clearly 
on the periphery of the field of education; each of them cites 
other subfields far more often than it is cited by them. 
Special education, as has been noted, is almost a field into 
itself; so is science and science education. The all other 
graphic cluster contains all those journals whose specialized 
nature was such that they had no direct link, through first 
or second arrows, with the other subfields. These are, almost 
by definition, on the periphery as a look at them in Figure 11 
will show. 
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We turn to Figure 20 to illustrate the centrality of 
certain subfields in education. The top line on the graph 
represents the percentage of its total journal citations each 
cluster gives to our journal set. The bottom line shows those 
percentages without self citation; i.e., with citations to 
journals within the subfield excluded. Thus the shaded area 
between the lines shows the effect of subfield self-citation 
on cross cluster citing. 

We see that eight of the clusters give 55 percent or more 
of their references to our journal set.* But when the effects 
of in-cluster citing are removed three distinct classes of 
clusters appear. Four subfields (call them Class I) child 
development, guidance, educational psychology and research, 
and elementary education and research, give between 30 percent 
and 40 percent of their total journal citations to other sub- 
fields in education. Four others. Class II, special education, 
science and science education, higher and general education and 
all other, fall within the narrow range of 22 to 23 percent. 
And two, clinical psychology, and experimental psychology, give 
only 13.7 percent and 9.8 percent, respectively, of their cita- 
tions to other subfields in education. (These last are Class 
III) . 

Class II subfields are all areas that have been shown 
above to be either self sufficient or closely linked to other 
disciplines. They are in education, but not of it. The two 
Class III subfields have already been identified as education's 
major source of the field's accepted common body of information. 
Thus Class I subfields represent the main body of education 
research. Child development (39.9%) and educational psychology 
and research (38.4%) make the heaviest use of educational jour- 
nals. They are followed closely by elementary education and 
research (35.7%); and finally, at 31.2 percent usage of other 
education journals, guidance. These fields represent educa- 
tion's central core, where work most dependent on other sub- 
fields of education is done. 



*The other two, higher and general education and all other, 
are, as has been noted previously, on the periphery of the 
field of education. 



60 



IX. REFERENCES 

1. Guilford, P. J., "The Nature of Human Intolligence, " 
McGraw-Hill, Inc., (1967). 

2. Narin, Francis, "Analysis of Research Journals, and 
Related Research Structure, in Special Education," 
Contract No. OEC-5-70-0047 (509) for the Office of 
Education (February 1971) . 

3. Cole, F. J. and Bales, Nellie B., "The History of Com- 
parative Anatomy," Science Progress XI, 578-596 (1917). 

4. Hulme, E. W., "Statistical Bibliography in Relation to 

the Growth of Modern Civilization," London, Grafton (1923). 

5. Gross, P.L.K. and Gross, E. M. , "College Libraries and 
Chemical Education," Science 66, 1713, 385-389 (1927). 

6. Stevens, RollcUid E., "Characteristics of Subject Litera- 
tures," Assoc. of College and Reference Libraries Mono- 
graph No. 6 , 10-21. 

7. Bradford, S. C, "Sources of Information on Specific 
Subjects," Engineering (London) 137, 85-86 (1934). 

8. de Solla Price, Derek J., Little Science Big Science , 
Columbia University Press, New York (196Tn 

de Solla Price, Derek J., Science Since Babylon , Yale 
University Press, New Haven (1961). 

9. Cole, Stephen and Cole, Jonathan R. , "Scientific Output 
and Recognition: A Study in the Operation of the Reward 
System in Science," American Sociological Review 62, 
377-390 (1967). — 

10. Crane, Diana, "The Gatekeepers of Science: Some Factors 
Affecting the Selection of Articles for Scientific 
Journals," American Sociologist 2, 4, 195-201, (1967). 

11. Zuckerman, Harriet and Merton, Robert K., "Sociology of 
Refereeing," Physics Today 24, 7, 28-33, (1971). 

12. Garvey, William D., Lin, Nan and Nelson, Carnot E., 
"Communication in the Physical and the Social Sciences," 
Science 170, 1166-1172, (1970). 

13. Xhignesse, Louis V. and Osgood, Charles E., "Bibliograph- 
ical Citation Characteristics of the Psychological Journal 
Network in 1950 and in 1960," American Psychologist 22, 
778-791 (1967). — 



61 



14. Van Cott, H. P, and Zavala, A., "Extracting the Basic 
Structure of Scientific Literature," American Institute 
for Research (1967). 

15. Kessler, M. M. , "Some Statistical Properties of Cita- 
tions in the Literature of Physics," Statistical 
Association Methods in Mechanized Documentation, 
Symposium Proceedings (1964). 

16. Stevens, Holland E., "Characteristics of Subject Litera- 
tures," Assoc. of College and Reference Libraries Mono- 
graph No. 6, 10-21. 

17. Hagstrom, Warren, "Factors Related to the Use of Differ- 
ent Modes of Puolishing Research in Four Scientific 
Fields," Communication Among Scientists and Engineers , 
ed . Carnot E. Nelson and Donald K. Pollock (Lexington, 
Mass.: Heath Lexington Books, D.C. Heath and Co., 1970). 

18. Narin, Francis and Gar side, Daniel, "Journal Relation- 
ships in Special Education," Excep clonal Children, 695- 
704 (May 1972) . 

19. Campr William L. , "Guide to Periodicals in Eaucation," 
The Scarecrow Press, Inc., Metuchen, N.J. (1968). 

20. Narin, Francis, Carpenter, Mark P. and Garside, Daniel B. , 
"Exploration of the Possibility of Generating Importance 
and Utilization Measures by Citation Indexing of Approxi- 
mately 500 Journals in the Physical Sciences," Contract 
No. NSF-C 627 for the National Science Foundation. Second 
Annual Report (August 1972). 

21. Carpenter, Mark P. 6Uid Narin, Francis, 'Clustering of 
Scientific Journals," to be published. 



62 



